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DETAILED ACTION 

1. This action is responsive to communications: Amendment filed 04/18/2006; 
Request for Continued Examination filed 04/18/2006. 

2. Claims 1-14 are pending. Claims 1, 7, and 10 are independent claims. 

Continued Examination Under 37 CFR 1.114 

3. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.1 14, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
04/18/2006 has been entered. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

5. Claims 1-5, 7-9, 13, and 14 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Escobar et al. (hereinafter "Escobar"), U.S. Patent No. 5,659,793 
issued August 1997. 
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Independent claim 1 cites: An editing system comprising: a timeline interface 
having at least one interactive track for interactive content and at least one track for 
time-based media, wherein interactive content may be associated with a point in time on 
the at least one track for interactive content; and 

Escobar teaches a multimedia application development tool with a timeline interface 
with multiple timelines, i.e., tracks (Col. 4, 1. 1-18) (Col. 6, 1. 23-29). At least one 
timeline is dedicated to interactive objects (Col. 4, 1. 17-18). Playback of objects on the 
timeline occurs in a time sequence indicated by their position on the timeline, resulting 
in time-based media. 

Claim 1 also cites: means for allowing a user to place interactive content on the 
at least one interactive track according to a selection of whether the interactive content 
is placed on the at least one interactive track either at a point in time with a locator 
object, wherein a locator object is an object that is attached to a source clip object in the 
timeline at a specified point in time on the clip, or for a duration with a source clip object 
wherein a source clip object is an object that has a start position and a duration in the 
track. 

Escobar teaches the application of a time code to allow an edit point to be defined as a 
certain duration from a clearly delineated starting point for asset playback (Col. 8, 1. 15- 
21 ). Escobar teaches that the user interface allows the user to associate properties 
with an object, including creating placeholder objects, and to assemble objects into 
applications with relative timing specified by their placement along the timeline tracks 
(Col. 6, 1. 30-41). Escobar teaches that the interactive content may be placed on the 



r 
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interactive track for a duration with a source clip object, where a source clip object is an 
object that has a start position and a duration in the track, since Escobar teaches a clip 
object with beginning and ending time codes, and a duration is a period of time (col. 9, 1. 
20-45). 

Claim 2 cites: The editing system of claim 1, further comprising: a bin for storing 
interactive content; 

means for importing interactive content into the bin such that interactive content 
is represented by an object in the bin, wherein the object is associated with a unique 
reference to the interactive content and wherein information describing the interactive 
content is stored as an attribute of the object; 

Escobar teaches a bin for storing interactive content (Col. 6, 1. 15-18). Escobar teaches 
a process of creating objects, where a bin is selected and properties are edited for the 
object by filling in a template (Col. 9, 1. 20-45); compare to and wherein information 
describing the interactive content is stored as an attribute of the object Files are stored 
in industry standard format (Col. 7, 1. 52-56). Because files are stored in industry 
standard format, it is inherent in the disclosure of Escobar that the file is associated with 
a unique reference, as industry standard format requires the unique identification of 
files. 

wherein the means for allowing a user to place interactive content on the at least 
one interactive track accesses objects representing the interactive content from the bin; 
and means for updating the information describing the interactive content stored as an 
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attribute of the object in the bin by accessing the interactive content using the unique 
reference in response to the user invoking a refresh operation. 

Escobar teaches a process by which the user views the contents of the bin and the user 
selects an icon from the bin for placement on the timeline, and selects the timeline track 
on which the icon is to be placed, then drags and drops the icon at the start time desired 
(Col. 10, 1. 10-36). Escobar teaches displaying accessing objects representing the 
interactive content from the bin, represented by icons, in Fig. 5E and Fig. 5H. Escobar 
also teaches a method of updating properties of the interactive content in the IDL by 
accessing the interactive content, using the file reference, in response to a refresh 
operation (col. 10, 1. 37-58 especially lines 55-58). Escobar teaches a means of editing 
objects in the bin, making changes to the object, and saving the revised properties for 
the object (Col. 9, 1. 45-63). 

Claim 3 cites: The editing system of claim 2, wherein the interactive content is a 
trigger element and the unique reference includes a file name for a trigger file including 
a description of the trigger element and a unique identifier of the trigger element 
Escobar teaches the creation and jjse of program objects, i.e., trigger files, to perform a 
variety of functions, which can be dragged and dropped onto interactive tracks (Col. 8, 1. 
29-67). The objects are stored and edited in the same manner as other objects stored 
in the bins. Escobar also teaches a method for storing a pointer to objects dropped on 
the timeline so that memory can be accessed to obtain the records referenced by the 
pointers at runtime (Col. 10, 1. 24-26, 1. 37-45). 
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Claim 4 cites: The editing system of claim 2, wherein the interactive content is a 
document and the unique reference includes a file name for the document 
Escobar teaches the creation of graphics or text overlay assets, i.e., documents with a 
graphic/text editor (Col. 9, 1. 64-Col. 10, 1. 9). Escobar teaches that files are stored in 
industry standard format (Col. 7, 1. 52-56). Because files are stored in industry standard 
format, it is inherent in the disclosure of Escobar that the file is associated with a file 
name, as industry, standard format requires the naming of files. 

Claim 5 cites: The editing system of claim 1, further comprising: a bin for storing 
interactive content; means for importing interactive content into the bin such that 
information about the interactive content is stored in the bin; wherein the means for 
allowing a user to place interactive content the at least one interactive track stores 
information about the interactive content as an attribute of the object used for the 
interactive content 

Escobar teaches a bin for storing interactive content (Col. 6, 1. 15-18). Escobar teaches 
a process of creating objects, where a bin is selected and properties are edited for the 
object by filling in a template, so that information about the content is stored in the bin 
(Col. 9, 1. 20-45). Fig. 6 of Escobar discloses timeline management where a data 
structure is associated with each timeline track; the structure is a linked list, and each 
entry in the list points to another data structure, which contains the information 
necessary to execute the object on the timeline (Col. 11,1. 30-35). This data structure 
stores information about the object as an attribute. 
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Amended independent claim 7 cites: An editing system comprising: a timeline 
interface for specifying a program having at least one interactive track for interactive 
content and at least one track for time-based media, wherein interactive content may be 
associated with a point in time on the at least one interactive track] 
Escobar teaches a multimedia application development tool with a timeline interface 
with multiple timelines, i.e., tracks (Col. 4, 1. 1-18) (Col. 6, 1. 23-29). At least one 
timeline is dedicated to interactive objects (Col. 4, 1. 17-18). Playback of objects on the 
timeline occurs in a time sequence indicated by their position on the timeline, resulting 
in time-based media. Escobar teaches the application of a time code to allow an edit 
point to be defined as a certain duration from a clearly delineated starting point for asset 
playback (Col. 8, 1. 15-21). Escobar teaches that the user interface allows the user to 
associate properties with an object, including creating placeholder objects, and to 
assemble objects into applications with relative timing specified by their placement 
along the timeline tracks (Col. 6, 1. 30-41). 

a bin for storing interactive content; 

means for importing interactive content into the bin such that interactive content 
is represented by an object in the bin f wherein the object is associated with a unique 
reference to the interactive content, and wherein information describing the interactive 
content is stored as an attribute of the object; 

Escobar teaches a bin for storing interactive content (Col. 6, 1. 15-18). Escobar teaches 
a process of creating objects, where a bin is selected and properties are edited for the 
object by filling in a template (Col. 9, 1. 20-45); compare to and wherein information 
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describing the interactive content is stored as an attribute of the object Files are stored 
in industry standard format (Col. 7, 1. 52-56). Because files are stored in industry 
standard format, it is inherent in the disclosure of Escobar that the file is associated with 
a unique reference, as industry standard format requires the unique identification of 
files. 

means for allowing a user to place interactive content represented by an object 
selected from the bin on the at least one interactive track; means for allowing a user to 
edit placement of the interactive content on the at least one interactive track and 
Escobar teaches a process by which the user views the contents of the bin and the user 
selects an icon from the bin for placement on the timeline, and selects the timeline track 
on which the icon is to be placed, then drags and drops the icon at the start time desired 
(Col. 10, 1. 10-36). Escobar teaches means for a user to edit placement on the 
interactive track (col. 10, 1. 10-36, esp. I. 23). 

means for updating the information describing the interactive content stored as 
an attribute of the object in the bin by accessing the interactive content using the unique 
reference in response to the user invoking a refresh operation. 

Escobar teaches a process by which the user views the contents of the bin and the user 
selects an icon from the bin for placement on the timeline, and selects the timeline track 
on which the icon is to be placed, then drags and drops the icon at the start time desired 
(Col. 10, 1. 10-36). Escobar teaches displaying accessing objects representing the 
interactive content from the bin, represented by icons, in Fig. 5E and Fig. 5H. Escobar 
also teaches a method of updating properties of the interactive content in the IDL by 
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accessing the interactive content, using the file reference, in response to a refresh 
operation (col. 10, 1. 37-58 especially lines 55-58). Escobar teaches a means of editing 
objects in the bin, making changes to the object, and saving the revised properties for 
the object (Col. 9, 1. 45-63). 

Regarding dependent claims 8 and 9, claims 8 and 9 reflect the same 
concepts described in the editing system as claimed in claims 3 and 4, and are rejected 
along the same rationale. 

Regarding dependent claim 13, Escobar also teaches a method of updating 
properties of the interactive content in the IDL by accessing the interactive content, 
using the file reference, in response to a refresh operation (col. 10, 1. 37-58 especially 
lines 55-58). Therefore, Escobar teaches a means of editing objects in the bin, making 
changes to the object, and saving the revised properties for the object in the IDL (Col. 9, 
I. 45-63). 

Regarding dependent claim 14, claim 14 is directed toward substantially similar 
subject matter as claimed in claim 13, and is rejected along the same rationale. 

Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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7. Claims 6 and 10-12 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar, and further in view of Kanda, U.S. Patent No. 
6,324,335 issued November 2001. 

Regarding dependent claim 6, Escobar teaches a multimedia application 
development tool, which includes graphics or text overlays, i.e., information to be 
displayed with video (Col. 8, 1. 64-Col. 10, 1. 9). Escobar teaches a means for playing 
back the program created with the timeline with an intelligent terminal or set top box or 
digital entertainment terminal (Col. 12, 1. 16-Col. 15, 1. 26). Escobar teaches a graphics 
display generator and video RAM that manipulate different planes of active video 
information (Col. 13, 1. 35-Col. 14, 1. 4). Escobar does not explicitly teach a specification 
of size and spatial position of the video relative to the information to be displayed in the 
display, or means for accessing the specification of the size and spatial position of the 
video for the interactive content corresponding to a point in time in the program, 
however, Kanda teaches data showing the size and spatial position of the video relative 
to the information displayed on the display (col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). 

Escobar does not explicitly teach a means for displaying the video and the 
display information of the interactive content according to the specification of the size 
and spatial position of the video relative to the information to be displayed in the display 
and the point in time in the program, however, Kanda teaches displaying the size and 
spatial position of the video relative to the information displayed on the display (Fig. 3; 
col. 17, I. 35-52; col. 17, 1. 53-col. 18, I. 14). 
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Both Escobar and Kanda are directed toward video editing systems. It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply 
Kanda to Escobar so that the user would have the benefit of an editing system capable 
of high speed real time edition and having improved usability (Kanda, Col. 1, 1. 44-46). 

Independent claim 10 cites: An editing system comprising: a timeline interface 
for specifying a program having at least one interactive track for interactive content and 
at least one track for video, wherein interactive content may be associated with a point 
in time on the at least one interactive track; 

Escobar teaches a multimedia application development tool with a timeline interface 
with multiple timelines, i.e., tracks (Col. 4, 1. 1-18) (Col. 6, 1. 23-29). At least one 
timeline is dedicated to interactive objects (Col. 4, 1. 17-18). Playback of objects on the 
timeline occurs in a time sequence indicated by their position on the timeline, resulting 
in time-based media. Escobar teaches the application of a time code to allow an edit 
point to be defined as a certain duration from a clearly delineated starting point for asset 
playback (Col. 8, 1. 15-21). Escobar teaches that the user interface allows the user to 
associate properties with an object, including creating placeholder objects, and to 
assemble objects into applications with relative timing specified by their placement 
along the timeline tracks (Col. 6, 1. 30-41). 

Claim 1 0 also cites: means for allowing a user to place interactive content on the 
at least one interactive track, wherein interactive content includes display information 
indicating information to be displayed in a display with the video from the at least one 
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track for video, and a specification of size and spatial position of the video relative to the 
information to be displayed in the display; and 

Escobar teaches a process by which the user views the contents of the bin of interactive 
content and the user selects an icon from the bin for placement on the timeline, and 
selects the timeline track on which the icon is to be placed, then drags and drops the 
icon at the start time desired (Col. 10, 1. 10-36). Escobar teaches a multimedia 
application development tool, which includes graphics or text overlays, i.e., information 
to be displayed with video (Col. 8, 1. 64-Col. 10, 1. 9). 

Escobar does not explicitly teach that the interactive content includes a 
specification of size and position of the video, however, Kanda teaches data showing 
the size and spatial position of the video relative to the information displayed on the 
display (col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). Kanda also teaches displaying the 
size and spatial position of the video relative to the information displayed on the display 
(Fig. 3; col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). Both Escobar and Kanda are 
directed toward video editing systems. It would have been obvious to one of ordinary 
skill in the art at the time of the invention to apply Kanda to Escobar so that the user 
would have the benefit of an editing system capable of high speed real time edition and 
having improved usability (Kanda, Col. 1, 1. 44-46). 

Claim 10 also cites: means for playing back the program specified by the 
timeline interface including: means for accessing the specification of the size and spatial 
position of the video for the interactive content corresponding to a point in time in the 
program; and means for displaying the video and the display information of the 
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interactive content according to the specification of the size and spatial position of the 
video relative to the information to be displayed in the display and the point in time in 
the program. 

Escobar does not explicitly teach a means for accessing and displaying the video 
and display information according to the specification and the point in time in the 
program, however, Kanda teaches data showing the size and spatial position of the 
video relative to the information displayed on the display (col. 17, 1. 35-52; col. 17, 1. 53- 
col. 18, 1. 14). Kanda also teaches displaying the size and spatial position of the video 
relative to the information displayed on the display (Fig. 3; col. 17, 1. 35-52; col. 17, 1. 53- 
col. 18, 1. 14). Both Escobar and Kanda are directed toward video editing systems. It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
apply Kanda to Escobar so that the user would have the benefit of an editing system 
capable of high speed real time edition and having improved usability (Kanda, Col. 1, 1. 
44-46). 

Dependent claim 11 cites: The editing system of claim 10, further comprising: 
means for allowing a user to select interactive content; 

Escobar teaches a means for a user to select an object of interactive content from a bin 
using icons (Col. 10, 1. 10-36). 

means for launching an authoring tool corresponding to the selected interactive 
content, and for causing the authoring tool to access and open for editing the selected 
interactive content 

Escobar teaches a software architecture which launches the authoring tool (Fig. 3, Col. 
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7, 1. 57-65), and a development environment utilized to create interactive multimedia 
applications (Col. 7, 1. 17-29). The tool is used to access and open the interactive 
content. 

Dependent claim 12 cites: The editing system of claim 10, further comprising: 
means for allowing the user to place time-based media on a track using one of a source 
clip object and a locator object; and 

Escobar teaches a method of placing an icon on a selected timeline track at a desired 
start time (Col. 10, 1. 15-36). The icon represents an object, which may be an edited 
section of raw video, i.e., a source clip object (Col. 9, 1. 46-63). A pointer to the object 
identified by the icon on the timeline track is then stored in a linked list for the selected 
timeline track at a location determined by its start time (Col. 10, 1. 24-26), therefore the 
pointer is a locator object. 

means for allowing the user to perform editing operations that affect source clip 
objects and locator objects, whereby interactive content and time-based media are 
edited in the same manner to maintain synchronization. 

Escobar teaches that objects may be created to permit easy manipulation of portions of 
an asset during creation of a specific application, while other objects are more functional 
and may be reused. Escobar discloses video objects, audio objects, text/graphical 
objects, special effects, program objects and applications (Col. 6, 1. 52-61). The user 
performs editing operations in a work space where currently selected objects may be 
displayed and edited (Fig. 1 , Col. 6, 1. 6-29). Escobar teaches that the objects are 
edited in the same manner (Col 9, 1. 20-Col. 10, 1. 35). 
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Response to Arguments 

Applicant's arguments filed 04/18/2006 have been fully considered but they are 
not persuasive. Regarding claims 1-5, applicant admits (Remarks, p. 6-8) that Escobar 
teaches either a starting and ending time or starting time and duration (p. 7, par. 3). 
Applicant has amended claim 1 to add the limitation, wherein a locator object is an 
object that is attached to a source clip object in the timeline at a specified point in time 
on the clip, or for a duration with a source clip object wherein a source clip object is an 
object that has a start position and a duration in the track. Escobar teaches that the 
interactive content may be placed on the interactive track for a duration with a source 
clip object, where a source clip object is an object that has a start position and a 
duration in the track, since Escobar teaches a clip object with beginning and ending 
time codes, and a duration is a period of time (col. 9, 1. 20-45). 
8. Regarding independent claim 7, applicant admits that Escobar teaches making 
an adjustment of the starting time of an object on the time line, thus the reliance on 
Kanda to teach the limitation means for allowing a user to edit placement of the 
interactive content on the at least one interactive track would be unnecessary 
(Remarks, p. 8, par. 6). The examiner agrees, and the rejections of claims 7-9 and 14 
have been changed accordingly, as being anticipated by Escobar under 35 
U.S.C. 102(b). 

Applicant argues that Escobar does not teach the limitation means for updating 
the information describing the interactive content stored as an attribute of the object in 
the bin by accessing the interactive content using the unique reference in response to 
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the user invoking a refresh operation (Claim 7). However, Escobar does teach a 
method of updating properties of the interactive content in the IDL by accessing the 
interactive content, using the file reference, in response to a refresh operation (col. 10, 1. 
37-58 especially lines 55-58). 

9. In response to applicant's arguments regarding claims 6 and 10-12, applicant 
has amended the claim limitations to claim a size and spatial position. Therefore, the 
new rationale for the claim rejections relies on the Kanda patent, which teaches data 
showing the size and spatial position of the video relative to the information displayed 
on the display (col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). Kanda also teaches 
displaying the size and spatial position of the video relative to the information displayed 
on the display (Fig. 3; col. 17, 1. 35-52; col. 17, 1. 53-col. 18, 1. 14). 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Amelia Rutledge whose telephone number is 571-272- 
7508. The examiner can normally be reached on Monday - Friday 9:30 - 6:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




